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A system is provided that en- 
hances the interactivity of multime- 
dia information in a closed cable net- 
work such as a hotel system or the 
like when utilized in conjunction with 
an on-line service. The system in- 
cludes a multimedia processing sys- 
tem (102), a telephone switching sys- 
tem (108), a video control system 
(104), a service operations platform 
(107), and a plurality of interactive 
devices (1 10, 125, 1 12, 114, I 17, 
119. 121, 123). This system has 
the advantage of providing compres- 
sion and/or transmission algorithms to 
maximize enhancement of the multi- 
media information. The system al- 
lows for enhanced interactivity of 
multimedia information by a closed 
cable system while allowing for en- 
hanced access to one or more on-line 
services with minimum modification 
to the existing network. 
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INTERACTIVE SYSTEM FOR A CLOSED CABLE NETWORK 
THAT INCLUDES HIGH SPEED ACCESS TO AN 
ON-LINE SERVICE AND THE INTERNET 



FIELD OF THE INVENTION 

The present invention relates to a closed cable network and more particularly the 
present invention relates to the transfer of multimedia information within such a network 
and between such a network and one or more on-line services. 

BACKGROUND OF THE INVENTION 

There are many types of closed cable networks. What is meant by closed cable 
networks in the context of the present application are networks which are self-contained and 
the users are easily identified. For example, a multinational or corporate hotel chain 
provides such a network. In such networks there is typically a facility in each room, office 
or the like for the presentation of information to a user. Typically this presentation takes the 
form of multimedia information. Oftentimes, that is information that includes elements of 
graphics video information that is provided to a customer, employee or the like via a 
television or like display. 

A critical characteristic of these types of networks is that there should be a path that 
provides the owner of the network with knowledge of the activities of a particular user on 
the network. For example, in the case of a hotel, if a customer orders a service, the owner of 
the hotel can identify that the service has been ordered by that particular customer. The 
major problem with existing closed cable networks is that they are not fully interactive. 
That is, it is oftentimes difficult to actively and efficiently access and transport information 
from and to the network in real time. 

To efficiently access and transmit information outside the network takes on greater 
significance when interacting with on-line services and the like. Furthermore, as Internet 
access becomes more commonplace, it becomes equally important to develop ways for 
closed cable systems to efficiently and effectively transmit and receive information over 
such a network. 

Accordingly what is needed is a system for providing efficient and effective access 
to multimedia information outside a closed network by a user who is inside such a network. 
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The system should be one that is minimally intrusive to the network and should not affect its 

normal operation. The present invention addresses such a need. 

SUMMARY OF THE INVENTION 

A system is provided that enhances the interactivity of multimedia information in a 
closed cable network such as a hotel system or the like when utilized in conjunction with on- 
line service. The system includes a multimedia processing plurality of multimedia 
processing system, a telephone switching system, a video control system, a service 
operations platform, and a plurality of interactive devices. This system has the advantage of 
providing compression and/or transmission algorithms to maximize enhancement of the 
multimedia information. The system allows for enhanced interactivity of multimedia 
information by a closed cable system while allowing for enhanced access to one or more on- 
line services with minimum modification to the existing network. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram of a prior art closed cable network. 
Figure 1 A is a matrix of bandwidth to usage of information. 
Figure IB is a diagram of global distribution network. 

Figure 2 is a block diagram of a general embodiment of an interactive multimedia 
system for use in a closed cable network. 

Figure 2A is a block diagram of a personal computer and an IMD utilized in the 
system of Figure 2. 

Figure 2B is a partial block diagram of a closed cable system. 

Figure 2C is an overlay of the telephone keypad. 

Figure 2D is a closed cable system for use with Internet access. 

Figure 2E is a block diagram of a high speed hotel Internet access system service 

center. 

Figure 2F is a diagram of a national satellite network. 
Figure 2G is a display on a workstation in the service center of Figure 2E. 
Figure 2H is a block diagram of a hotel intranet system in accordance with the 
present invention. 

Figure 21 is a block diagram of a point to point system utilized in the system of 
Figure 2. 
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Figure 2J is a block diagram of a multimedia multiplexer coupled to an interactive 
multimedia decoder. 

Figure 2K is a block diagram of a global multimedia decoder. 
Figure 2L is a block diagram of a multimedia processing center (MPC) in 
accordance with the system of Figure 2. 

Figure 3 is a block representation of the multimedia processing system (MPS) in 
accordance with the present invention. 

Figure 4 is a first specific embodiment of an interactive multimedia system for use in 
a closed cable network. 

Figure 5 is a second specific embodiment of an interactive multimedia system for 
use in a closed cable network. 

Figure 6 is a flow chart of a first embodiment of the optimization method which is 
utilized in the closed cable network in accordance with the present invention. 

Figure 7 is a representation of the separation of primary and secondary multimedia 
15 information. 

Figure 8 is a flow chart of a second embodiment of the optimization method 
showing the cooperation of a compression algorithm with a transmission algorithm in 
accordance with the present invention. 

Figure 9 is a block that shows the cooperation of a compression algorithm with a 

2 0 transmission algorithm in accordance with the present invention. 

Figure 10 is a block representation of digital information of an image file and a 
MIDI file. 

Figure 1 1 is a block diagram of a general embodiment of an interactive multimedia 
device (IMD) in accordance with the present invention. 
25 Figure 12 is a representation of a remote control utilized in conjunction with the 

system architecture of the present invention. 

Figure 13 is a flow chart of a reservation system that utilizes the interactive system 
in accordance with the present invention. 

Figure 14 is a flow chart of a shopping system that utilizes the interactive system in 

3 0 accordance with the present invention. 

Figure 14a is a flow chart of a portion of the shopping system of Figure 14. 
Figure 15 is a flow chart of a movie review and ordering system that utilizes the 
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interactive system in accordance with the present invention. 

Figure 15 A is a flow chart of a portion of the movie review and ordering system of 
Figure 15. 

Figure 16 is a flow chart of a ticketing system that utilizes the interactive system in 
accordance with the present invention. 

Figure 17 is a flow chart of a map generating system that utilizes the interactive 
system in accordance with the present invention. 

Figure 18A is a block diagram of an electronic inventory control system utilized in 
the interactive system in accordance with the present invention. 

Figure 18B is a block diagram of a physical inventory control system utilized in the 
interactive system in accordance with the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

The present invention relates to an interactive system for a closed cable network. 
The following description is presented to enable one of ordinary skill in the art to make and 
use the invention and is provided in the context of a patent application and its requirements. 
Various modifications to the preferred embodiment will be readily apparent to those skilled 
in the art and the generic principles and features described herein may be applied to other 
embodiments. Thus the present invention is not intended to be limited to the embodiment 
shown but is to be accorded the widest scope consistent with the principles and features 
described herein. 

Referring now to Figure 1, what is shown in simple block diagram form is a prior art 
closed cable network. In the following discussion the present invention will be discussed in 
the context of a hotel system. It should be understood however that there are other types of 
closed cable networks such as hospitals, educational institutions and many conventional 
cable head end networks or the like where the principles of the present invention would 
apply. 

The system 10 includes a hotel PBX system 12 for receiving and transmitting 
telephone calls, property management system 14 and a video control system 16 which could 
be used to access the pay per view movies or the like. The video control system 16 includes 
an in-room remote link and is connected to the services operation platform 14. The property 
management system (PMS) 14 keeps track of the users that order the movies. 
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The system 10 as above described is not fully interactive. In this type of system 
there are a number of video units or VCRs located within the system and they are switched 
in when the appropriate customer or client wants to use the video unit. One problem in this 
type of system is that these video units cannot be individualized to a particular user because 
there are simply not enough units. For example, there may be a bank of 64 VCRs which 
would service a 500 room hotel. Each of the VCRs would have a separate movie. 
Accordingly, in this case there is a possibility that a particular movie would not be available. 
In addition, this type of arrangement severely limits the number of choices available. 

Another problem with the conventional system is that the users do not easily have 
access to information outside the system. More particularly, as the Internet and other on- 
line services become readily utilized it is important to provide the user with easier access to 
such services. Although these services could be accessed by conventional methods (such as 
an individual bringing a computer into the hotel room or the like) this is not always possible 
and oftentimes the particular computer may not be fully equipped to provide such access in 
15 an efficient and time critical fashion. 

In addition, there is a need to provide high speed access to multimedia information 
from an on-line service to provide quick retrieval and review of such information. A closed 
cable system provides the opportunity to develop such an environment. Finally such a 
system allows for the user to be easily identified for marketing and other purposes. In 
addition, it would be desirable to provide for a closed system which includes means for 
interactively accessing a variety of services which are outside the network. 

The present invention is directed toward an improvement in a closed cable system 
which enhances interactivity, particularly for Internet applications. A system and method in 
accordance with the present invention includes the following elements: a software browser, 
which can be utilized with a closed cable system, a global distribution architecture, and a 
way to provide telephone print mapping to such an architecture. The system and method 
also includes methods for issuance of tickets or coupons in a credit card application. A 
system and method in accordance with the present invention can be used advantageously in 
a video game and network environment as well as other types of interactive environments. 

A critical feature of the present invention is advertising in such a closed cable 
system because the user of the network can be easily identified. For example, in most on- 
line systems and particularly the Internet it is not possible, given the listing of the different 
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passwords and names utilized by an individual, it is not necessarily possible to identify the 
user. However, in a closed cable system, such as a hotel or the like, you are able to identify 
a particular user. Accordingly, for these and the following reasons, this enhanced closed 
cable system has significant utility over prior art systems. 

Global nkmhutipn Architpr.fl irf 

One advantage of the present invention is that Internet access can be speeded by 
providing a high speed access conduit into the closed cable system. In so doing, an 
improved system can be provided. In a typical hotel system, for example, the bandwidth of 
the interconnect to the system is the limiting factor. What has been determined is that by 
distributing the pieces of information throughout various sites, can provide high speed links 
to a particular site on the Internet, thereby allowing for quicker access thereto. 

Before the present invention is described in detail certain information should be 
discussed to clarify the utility of the present invention in terms of existing closed cable 
networks. A multimedia system is a system which provides multimedia information to a 
user. In a multimedia system, various sensory information is provided to a receiver. In the 
case of video information, this information can take the form of foreground and background 
images that display a particular scene. In the case of audio information, the foreground and 
background signals could be such that the foreground information is speech and the 
background information is music. 

Typically, multimedia systems in whatever form provide this information over a 
single transmission line. In so doing, the amount and quality of the multimedia information 
is severely limited by the bandwidth of the transmission line. 

The present invention first differentiates between important and less important 
multimedia information by separating the information into primary and secondary layers 
through the use of a program model to minimize the bandwidth limitations. In such a 
system each layer will have its own set of parameters that are important psychograph.cally, 
however, for example, the secondary layer may not vary as much as the primary layer. 

What is meant by a program model refers to psychographic parameters within the 
multimedia system, that is parameters that relate to an individual's sensory perceptions when 
encountering multimedia information. These parameters comprise a set of unique and 
consistent elements for a particular class of multimedia information. In accordance with the 
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present invention, the multimedia information is separated into different layers in 
accordance with the program model. Therefore, by way of example, in the instance of video 
images, the foreground and background information might be divided into different layers. 
Similarly, in the case of audio information, the news information, weather information, or 
the like may be one layer whereas the background music may be the other layer. 

In the present invention, these layers will be divided into primary and secondary 
layers in accordance with the information's importance relative to the program model. The 
most important information is identified and enhanced to provide the best quality 
information to the receiver of the multimedia information. 

In the preferred embodiment, the primary layers will be enhanced in such a way to 
provide a perceived improvement in quality of the multimedia information presented. In 
one embodiment the secondary layers are presented that may or may not be enhanced. 
Thereby the important information or the primary layers that are to be transmitted can be 
identified and selectively enhanced in accordance with the present invention. 

In addition, the primary layers generally can be enhanced through critical 
psychographic parameters take the form of spatial, color, audio, and temporal variables that 
occur in the primary or secondary layers. 

In a closed cable network such as a hotel system it is important that the multimedia 
information that is produced, transmitted and received is enhanced in some manner. This is 
necessary to ensure that high fidelity, high quality information is presented to the viewer. 
Therefore, it will be possible to bring a superior transmission into the network. It has been 
possible to provide video information over the telephone lines. However, it has typically 
been difficult to send high quality video information over the telephone lines due to the 
bandwidth requirements that are needed to provide such high quality video information. 

The present invention is directed towards a method and apparatus for enhancing the 
interactive multimedia information that is utilized within a closed cable network, 
particularly information that is provided for a source that is outside of the network. In a 
preferred embodiment, as will be described in more detail later, a program model can be 
utilized to separate the information into a usage distribution in the primary and secondary 
layers. Accordingly, referring to Figure 1 A, what is shown is a matrix of usage of the 
information to bandwidth of the system. The high use information can be stored in a local 
storage and high bandwidth information can be stored locally. Low use, low bandwidth 
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information can be stored, for example, in a remote location. To more fully explain such a 
method and apparatus, refer now to Figures 2-5 which shows a block diagram of a general 
embodiment and block diagrams of two specific embodiments of the overall system 
architecture for an enhanced interactive multimedia system for a closed cable network. The 
overall architecture would be connected to the hotel PBX or the like so as to readily access 
the transmission lines located therein. 

Referring first to Figure 2, the overall general architecture 100 includes a 
multimedia processing system (MPS) 102 which is coupled to receive information from and 
transmit information to a video control system 104, an account computer 106, a service 
operations platform SOP 107, a telephony switching system 108, and an Internet data 
connection 195. The MPS 100 is also coupled to an interactive multimedia decoder (IMD) 
1 10, a CD/I device 1 12, a laser disk 117, video camera 121, compact disk (CD) player 125, 
personal computer (PC) 1 19, video camera recorder (VCR) 123 and other devices 1 14. In 
this system each of these devices can be utilized to provide updatable multimedia 
information. For example, a compact disk player 125 can be utilized to jump to different 
places to provide multimedia information. It could be utilized in conjunction with an IMD 
to augment the fixed media with interactive material (updatable video source) material. 

A personal computer 1 19 can be utilized in conjunction with the IMD 1 10 as shown 
in Figure 2A to mesh a composite signal (audio, video) utilizing a multimedia selection. 
Some examples for the use of such a system are on-line services, games or maps and the 
like. 

The personal computer 1 19 could be utilized as a device in a room, or it could be in 
the basement of, for example, the hotel system to provide for access to different data. 
Referring now to Figure 2B, which is a partial block diagram of a closed cable system, what 
is shown is a data connection 195 coupled to the MPS. This data connection, for example, 
could be coupled to the Internet, via satellite, telephone or cable feed. This data connection 
195 allows for access to the Internet and also allows for passing that connection to the PC 
1 19 to provide a video output via converter 197. That video signal is then converted to be 
provided to the television. Once the video signal is provided, for example, there are several 
ways to control access to the Internet via that converted video signal. For example, a 
keyboard could be used which is directly wired to the cable. Also a keyboard could be used 
to provide an infrared connection to the TV or could provide a connection to the telephone. 
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In addition, a remote control could be utilized which includes some type of mapping which 
would allow for the selection of materials such as an on screen typewriter template. In 
addition, another example would be a telephone keypad which would provide a DTMF tone 
that would combine with a translator to provide data string conversion. This in turn would 
drive the input to the Internet selection. 

Finally, a laptop PC could be used that is connected to the telephone or cable. 
Software within the laptop PC could direct modem connections to the MPS to link the 
system to the MPS. 

A return path must be provided through the network. One way to provide a return 
path is through the video cable system, either via an infrared connection or a direct data 
connection. Another means for a network which could be utilized to provide the return path 
is the telephone system via the PBX. 

The different in-room devices can interact with either of the networks in a variety of 
fashions. For example, the keyboard and mouse could be used to provide a direct cable box 
to the video cable system or could be by wire directly coupled to the video cable system to 
access and control access to the Internet from the room. 

The keyboard/mouse that is wired could also be directly coupled to the telephone 
system. An infrared keyboard/mouse could be attached through a cable box to access the 
video cable system or could be coupled to the telephone system or PBX. 

In an example, the keyboard/mouse could have an infrared emitter which provides 
signals directly to the cable box for controlling the cable system directly. In another 
embodiment the remote control utilized for the television in the hotel room could be utilized 
within a hotel room, for example, to access the cable system as well as making selections on 
the cable system through the keypad and a mapping arrangement, e.g., on screen keyboard 
2 5 or hot area, cursor selection. 

The telephone keypad can also directly access the MPS through a key data string 
conversion to drive the input for the Internet selection. The telephone keypad could be 
utilized as a device that could mimic the point and click motions necessary to access the 
Internet. 

Referring now to Figure 2C, an overlay of the telephone keypad could allow certain 
keypads to mimic the point and click characteristics of the typical Internet access. By using 
the overlay to indicate that certain keys are for up, down, left and right notions, the 
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telephone keypad could be utilized advantageously to access the Internet. 

This type of system can be utilized advantageously to provide high speed access in a 
closed cable system, such as a hotel or the like, service center for the Internet. 

Referring now to Figure 2D which is a closed cable system for use with Internet 
access, what is provided is a dish 196 that receives a satellite feed which can provide 
information to a server 199 via a PMS 207. The server 199 is connected to a direct outside 
telephone line for transmitting calls and can receive in-bound phone calls via a PBX system 
21 1. It is also coupled to a video network 213 in the hotel environment which in turn is 
coupled to individual work stations 2 1 5. Finally, the network includes a printer coupled to 
the server 199. This system could be utilized to provide high speed Internet access. 

To provide a more detailed view of a high speed hotel Internet access system service 
center 285, refer now to Figure 2E. In this Figure, what is shown is a plurality of Internet 
access workstations 215 which are coupled to a network 295 and a satellite communications 
controller 297 which is coupled to a high speed Internet access satellite dish 294. In 
addition, there is a server which is coupled to a printer. This service center will allow for 
high speed access through the satellite feed. 

Figure 2F is a diagram of a national satellite network. In this environment 
workstations are the point of entry into the Internet access system. Outbound 
communications will take place over conventional telephone lines while inbound 
communications will be provided from remote web sites to be delivered to the workstations 
via the Internet control system. Through this asymmetrical provision of information 
communications, data can be provided in a more efficient manner. 

Referring now to Figure 2G, what is shown is what would be displayed on a 
workstation in the service center. The user could access various areas either within the 
closed cable system or on the Internet using traditional keyboard mouse interactions. Hence, 
as is seen by clicking on "7" NETGATE could be entered to provide Internet access. Hotel 
guests could, for example, use workstations as a point of entry into the high speed Internet 
access system. Outbound communications will take place over conventional telephone lines 
while inbound communication from remote web sites will be delivered to the work station 
via the satellite system. Through this system, an improved speed of access is provided. 

Generally, a remote control network for access to the Internet is provided. Through 
this system, an Internet session can be displayed via keypad, telephone set, or remote 
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control. A PC application, for example, which would allow for access to a network is 
through the PC application of video games. Through this access the PC can be used to 
control access to the network. This system would allow for multiplayer games to be 
utilized, for example, over the Internet which will allow for multiple players to play, not 
only within the hotel system but also out to the Internet community. 

One of the advantages of using this system in the Internet is that there is the ability 
to tag different demographics directly through the closed cable system. One of the 
weaknesses of the Internet is it is not easy to track the particular individuals using the 
Internet on a consistent basis. For example, typically on the Internet a user may have 
several different user names for performing certain searches or other requests. The system 
in accordance with the present invention provides advantages thereover such as, one could 
present to website certain information about a particular user. The website could then allow 
for a unique presentation to a user. For example, if a particular user is reviewing an 
automobile website, (i.e., Mercedes Benz), then links to that website can be customized for 
the particular user, such as to a top of the line car stereo system or the like. Through the use 
of this information, a tag can be provided to identify a user. This tag can be used in a 
variety of ways to provide demographic information to a particular advertiser. Hence that 
data could be encoded, packetized and then provided to the advertiser in a particular format 
so that the advertiser would know the buying patterns and other information about the 
particular user. This significantly enhances the value of the communications. 

Referring now to Figure 2H, what is shown is a hotel intranet system. The system 
includes a Network Center 151 which receives and transmits information to a plurality of 
hotels 153a- 153c. There is a common database 159 which includes a variety of value 
information. The value information might include billing information, profile information 
of the user. The system can also be linked to use databases, demographic client marketing 
databases. This system provides a clear mechanism for locating or establishing contact with 



a user. 



In an example, the user can check in to a hotel within the user system and be 
immediately identified by the hotel. A delivery cycle of a message to such a user might 
include turn-on in room message light on the telephone or the like. That in room message 
could be a voice mail message, email message, facsimile or some other type of message. 

Accordingly, in one embodiment, the message would be to a user, "Hello 'user' (any 
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name) you have five email messages, two outside voice mail messages, six facsimiles and 
five downloads of software." The user could attempt to access this information through a 
business center as before described, from an in-room TV (i.e., Internet, intranet or 
otherwise), through the telephone or through a pnnter or the like located either in the user 
room or at the hotel front desk. Through this hotel messaging interface there is provided the 
ability to provide synchronization between the PBX telephone and the Internet. By 
providing a connection to the website of, for example, an internet registration website such 
as AT&T, there is the ability to link through that website a PBX connection directly through 
a telemarketing or customer service group to serve the needs of a customer AT&T or 
another long distance carrier. Since the hotel database includes a profile such as likes, 
bookmarks, setting of the telev.sion that allows the hotel to set up a custom interactive 
environment. 

A VCR 123 or CD player 125 could be utilized in such a system, for example, for 
movie preview, catalog shopping, and a music listening system from the Internet. Through 
this system full interactivity could be obtained. 

Video conferencing can be implemented for point to point or point to multiple point 
video conferencing. For example, referring now to Figure 21, what is shown is a point to 
multiple point video conference system 500. In this type of system, a video conference 
room (VC) can be utilized to transmit to multiple sites. This system can be utilized with the 
IMD 1 10 to provide updatable multimedia information. 

Similarly, a point to point system, in which there is a video camera in each guest's 
room, can be utilized. In this embodiment, a video multiplexer can be utilized to send 
updatable multimedia information from point to point (room to room) dependent on the type 
of information presented. 

An advantage of this system is to provide means for switching between alternate 
multimedia information at the head end. This allows for switching between analog and 
digital; data and graphics, music and video, etc. To more fully explain the advantage of this 
feature refer now to Figure 2 J. Figure 2J shows a multimedia multiplexer (MM) 135 
coupled to an IMD 1 10. In this embodiment the MM 135 can send information from a 
plurality multimedia sources to the IMD 1 10. 

In a preferred embodiment to provide for maximum resource allocation refer now to 
Figure 2K which shows a global multimedia multiplexer (GMM) 137. The GMM 137 
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would typically include a plurality of multimedia lines (mm 0 - mm„) for receiving 
multimedia source material. The GMM 137 receives information from a plurality of 
multimedia devices such as a PC, VCR, LD, CD-ROM, and CD/I devices. It can also be 
utilized as a network output of a PC or network access to the Internet. The output of the 
GMM 137 is provided to a plurality of IMDs 1 10 (IMD 0 - IMD„). The GMM 137 receives 
signals from a control channel 139 either from a MPS or the IMDs or other outside source. 
Through this device any multimedia source or combination of sources (mm 0 - mnO can be 
directed to any decoder or interactive channel (IMD 0 - IMDJ. This GMM 137 can be 
implemented in a variety of ways, for example, it can be a digital crosspoint switch. 
Through such a device a combination of multimedia devices can be utilized to produce a 
composite signal. This type of system can also be described to separate the information into 
primary and secondary layers as applied to a network. Accordingly, some of the 
information can be stored in the IMDS locally, for example, and some information can be 
stored remotely, dependent upon the bandwidth usage configuration of Figure A. 

Referring now to Figure IB, the GMM can be utilized to control the network pieces 
such as the video conference (VC), a personal computer (PC) and/or an IMD such that an 
integrated composite website can be created which can provide efficient access to critical 
information. 

Referring back to Figure 2, the cable feed line in turn is coupled to the video control 
system 104. The account computer 106 and the SOP 107 are also directly coupled to the 
telephone switching system 108 via line 120. The telephone switching system 108 is 
capable of sending and receiving outside calls. The video control system 104 is capable of 
sending and receiving a remote signal from a cable system, telecommunication system or the 
like. 

Another portion of the invention is an interactive voice response system 111. This 
system includes a telephone 1 13 which connects to the telephony switching 108 via 
telephone links. The telephone 1 13 also could include a credit card slot. There is also 
included within the system 1 1 1, a remote control 900 which will be described in detail later 
and a television 1 15 which is coupled to the cable 1 16. 

In this general embodiment, the multimedia processing system (MPS) 102 receives 
program source material from the SOP 107 and from the control system 104. The control 
system 104 can be a pay per view system such as a On-Command™ Video or a different 
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type of service, such as a shopping, buying movie or airline tickets, or the like. The MPS 
can also operate an interactive voice response program independently or integrated into 
other interactive multimedia programs. 

The SOP 107 is utilized for receiving e-mail, facsimile and voice messages. The 
SOP 107 can also be utilized m conjunction with pagers and the like to relay messages. By 
linking the account computer 106 to MPS 102 messages can be displayed on a monitor 
within the guest room. In addition, faxes can be displayed on the television and could be 
forwarded to other locations. 

A master multimedia processing center (MPC) 1 09 is also coupled to the closed 
cable system 100 via connection to the MPS 102. The MPC 109 is coupled to a plurality of 
closed cable systems to provide enhanced interact.vity thereto. Referring now to Figure 2L 
what is shown is a block diagram of the MPC 109. The MPC 109 comprises an interactive 
multimedia mastering system 1 1 1 which receives program source material from various 
outside sources and a MPS 102 wh.ch receives source material from the IMM 1 i 1 and can 
also receive data information over a program port 1 13 and an auxiliary port 1 15. 

Referring back to Figure 2, a critical portion of the system 100 is the telephone 
switching system 108 interface to an outs.de source of information. Through the use of this 
architecture the switching system 108 can be controlled to provide the appropriate 
information to the user. Through the use of the interface devices (IMD 1 10, CD/I 1 12 and 
the other device 1 14) and the MPS 102, the switching system 108 can be controlled in such a 
manner that the user doesn't have to remember a telephone number to obtain the desired 
information. This control can be accomplished through either a digital link that is directly 
interfaced to the telephone switching system 108 or through an analog link where only a 
normal phone connection to the system. Through either of the systems an emulation of the 
customer actions would be undertaken. 

In a typical example, a call is made by the user to order a service. The MPS 102 
places call to the room through control of the system 108. The room telephone will ring and 
the MPS 102 will send a message to the switching system 108 that the customer would like 
to access a service, in this case, a restaurant where the customer would like to make 
reservations. It should be understood in the alternative to the above that the restaurant could 
be called first via the system 108 and then the MPS 102 would call the customer back. The 
switching system 108 will then call the restaurant, introduce the caller and then the 



eeieoasAi> 



SUBSTITUTE SHEET (RULE 26) 



WO 98/16028 



IS 



PCT/US97/18267 



10 



15 



20 



25 



30 



restaurant will be linked to the room. All of these activities are done transparently to the 
user. Through the use of this system 100 it is also possible to pnnt out faxes and or receipts 
directly at the front desk of a hotel or the like. 

The system 100 is capable of transaction processing via the multimedia in a variety 
of ways. For example, transactions can be processed by posting billing information to a 
computer within the closed cable system, a facsimile ordering system within the system or 
through a voice order processing. 

The MPS 102 will provide and receive information relating to movies and other 
services from and to interface devices 1 10, 1 12, and 1 14. The interface devices 1 10, 1 12, 
and 1 14 are in the hotel facilities connected either to the hotel video cable system through 
use of the video/audio outputs or connected via digital links from interface devices 1 10, 1 12 
and 1 14 in each guest's room. 

Referring now to Figure 3 what is shown is the preferred embodiment of a MPS 102. 
The MPS 102 comprises a distributed computing architecture. The distributed computing 
architecture includes a master node 200 that has, in this case, three server nodes 204, 206, 
and 208 for the IMD, CD/I and the other devices respectively. The other devices that could 
be coupled to MPS 102 are,for example, but not limited to video games, a CD ROM device, 
a personal computer, or a specialty device such as a translator or gaming device such as a 
video slot machine or the like. 

Each of the server nodes 204, 206 and 208 have client nodes 210, 212, 214, 216, 
218, and 220 connected to the respective interactive devices. Attached to each of the clients 
nodes 210, 212, 214,216, and 218 ports 220. When connected via the existing networks or 
the MPC 109 (Figure 2a) and then on to connection to the interactive devices 1 10, 1 12, and 
1 14 (Figure 2) which has its own processing storage and computing structure the entire 
network can be operated as a massive distributed computing environment. 

This environment shares all dimensions of computing, storage, transmission and 
peripheral resources (printing, product ordering, mailing functions, etc.). This type of 
computing architecture would include dynamic port allocation and would include 
incremental failure characteristics to allow for robustness of the MPS 102. 

In addition through the use of this interactive system 100 of the present invention a 
multiplicity of different interactive devices can be utilized and no modification to the device 
need be made to allow for devices' use within the system. Accordingly the link between the 
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MPS 102 and the interactive devices can be a serial link, a CD/I link, a cable link such as 
ethemet or telephone connection via a simple infrared relay control link. Since the MPS 102 
can transmit and receive data as well as control information it can operate utilizing a wide 
range and types of interactive devices such as video games, CD ROM, personal computer or 
specialty instruments such as translators via an Internet or other on-line services means. 

In a first more specific embodiment shown in Figure 4, the multimedia processing 
system (MPS) 102 receives program source material from the services operation platform 
(SOP) 107' and from a pay video control system 104'. The control system 104' can be a pay 
per view system such as a On-Command tm Video or a different type of service, such as a 
shopping, buying movie or airline tickets, or the like. 

The SOP 107' is utilized for receiving e-mail, facsimile and voice messages. The 
SOP 107' can also be utilized in conjunction with pagers and the like to relay messages. By 
linking the SOP 107' to MPS 102 messages can be d.splayed on a monitor within the guest 
room. In addition, faxes can be displayed on the television and could be forwarded to other 
locations. 

The multimedia processing system 102 will provide and receive information relating 
to movies and other services from to interactive devices 1 10' and 1 12'. The interactive 
devices 1 10' and 112' will be located in the hotel facilities connected either to the hotel 
video cable system through use of the video/audio outputs or connected via digital links 
from interactive devices 1 10' and 1 12' in each guest's room. 

In a second more specific embodiment shown in Figure 5 the architecture is similar 
except that there is an IMD 1 10 in each guest room. The IMD 1 10 can also be used within 
an interactive voice response system 1 19 to provide a more complete interactive system. In 
this embodiment, the IMDs 1 10" can be utilized to provide the interactivity for each room. 
The structure of the IMDs 1 10" will be described in detail later in this specification. 

The IMDs 1 10 can take on many different forms dependent upon how much 
intelligence is located in an IMD 1 10 relative to the system architecture 100. The system 
architecture 100 shown in different aspects in Figures 2-5 provides program materia! which 
will enhance the interactivity of information that is transmitted along the video network. 
Accordingly, what the system architecture 100 represents, in fact, is an additional network 
which would receive information from the program source which would also be part of the 
existing closed cable system could receive information outside of the cable network through 
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the Internet or other on-line services system. The system architecture 100 will then be 
utilized to provide for enhanced multimedia information through psychographic 
manipulations or other enhancements to the systems to provide for an improved interactive 
closed cable system. 

Within each of the IMDs 1 10 of the system 100 is an optimization technique for 
enhancing the quality of the multimedia information that is present. To more specifically 
describe this optimization technique, refer now to Figure 6 which is a block diagram of an 
optimization method in accordance with the present invention. This optimization technique 

has been described in detail in U.S. Patent Application Number , entitled, "Method for 

the Production and Transmission of Enhanced Multim e dia Information " having a filing 
date of 

, assigned to the assignee in the present invention, and that patent application is 

incorporated by reference in this application. The following paragraphs along with the 
accompanying figures will provide the details regarding the optimization method and how it 
will be used advantageously to provide an enhanced interactive multimedia system. 

The purpose of the IMD 1 10 is to provide maximum interactivity while at the same 
time providing maximum retention of the program model. It is also important that there be 
minimum transit time for the interactivity while the information has maximum replication. 
Therefore, it is very important that the program model psychographic parameters be well 
2 0 described. For example, the spatial, color, temporal, audio response, material concept, 

contention perception all should be very well described and defined in the program model. 

Referring again now to Figure 6 what is shown is a first embodiment of a flow chart 
for providing an enhanced interactive multimedia information that utilizes the principles of 
the present invention. The flow chart 300 comprises the steps of providing a program model 

2 5 to a separator. The separator 302 will divide the information into primary and secondary 

layers of interactive multimedia information. The separation is automatic and can be 
accomplished in a variety of ways. For example, the layers can be separated by production 
sources. In another example, separation can be accomplished through key coding the layers. 
As previously mentioned, the information with regard to Figure 1, the information can be 

3 0 separated in accordance with a matrix of bandwidth and used to provide storage either 

remotely or locally dependent upon the particular configuration. In yet a fourth example, 
the layers can be spatially separated or separated by the various colors. The layers would be 
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separated in accordance with use and bandwidth requirements to provide enhanced 
interactivity. Finally, layers of information could be separated by a filtering process. 

The primary layers are provided to the compression generation block 304. There are 
a variety of ways that the multimedia data can be changed or generated to use less 
bandwidth. For example, compression algorithms or their equivalents could be utilized to 
reduce the bandwidth used. In addition generators, such as in a tone generator system, could 
be utilized to reduce the bandwidth required. Finally, key coding systems could be utilized 
to reduce bandwidth use. Such systems will be discussed in more detail later in the 
specification. 

In this embodiment, the primary layer is provided to an encoder where the primary 
layer is prepared for transmission (block 308). Thereafter the primary layer of information 
is decompressed (block 1 10). The pnmary layer is then decoded and mixed with the 
secondary layer of data information (block 3 12) to provide an enhanced interactive 
multimedia image (motion, video or other) or data to a display. 

Similarly, the secondary layer is compressed through block 314, encoded (block 
316) and then transmitted to block 318 to decompress and mix block 310. The two signals 
(primary and secondary) are then sent to display 3 12. 

In this embodiment, for example, for the optimization of video images, the pnmary 
layer can be the foreground image, the secondary layer can be a background image. 
Through the use of this type of optimization technique multimedia information can be 
enhanced while at the same time utilizing significantly less bandwidth. In addition, by 
optimizing both layers, full motion video is possible. 

To more fully understand this feature refer now to the following discussion. In a 
typical interactive multimedia system the information is all sent along one layer. The 
information that can then be transmitted is limited by the bandwidth of that layer. 

In the prior art, the interactive multimedia information that could be transmitted 
along typical networks or transmission paths that are very limited because, for example, in 
the case of video images the bandwidth is not adequate to provide a high quality image to a 
display. 

Hence, in the present invention, by separating the multimedia information into 
primary and secondary layers and thereafter compressing the more important information 
utilizing well known compression algorithms, a system is described that can produce 
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enhanced interactive multimedia information that easily be transmitted over existing 
networks. 

To more fully describe the psychographic enhancement feature of the present 
invention refer now to Figure 7 which shown the various possibilities from a particular 
program model. What is meant by program model could be a specified modeling language, 
for example, HTML or VRML. The form of the various components of the modeling can be 
specified for the particular user. The program model is provided to the separator 302 of the 
multimedia system. 

Psychographic enhancements are critical to the improvement in interactive 
multimedia transmission and reception enhancements in the context of the present 
application is information that is not transmitted but operates on, operates in conjunction 
with, or operates as a supplement to transmitted multimedia information. There are three 
separate categories that will be described that relate to psychographic enhancements. 

The first category will be described as a cross correlation between the information 
that is being transmitted and being enhanced due to the presence of information that is not 
transmitted. Dithering of image is an example of this in that dithering masks artifacts of 
images that are present and that improves the image quality. This type of system does not 
remove the artifacts but actually just masks imperfections. A second example in the audio 
arena where secondary audio materials such as a sound of an ocean or the like which might 
mask problems in the audio quality of the primary sound (voice, music or the like). 

The second category is where the signal is actually changed without the use of any 
control signal; for example, through interpolation^ some other technique. The typical 
example of that is a graphic equalizer in which certain frequencies are enhanced depending 
on the range of the particular device. Another example of the second category is to 
frequency or amplitude compress a certain signal so as to further enhance the frequencies 
that are being transmitted. It is also known to use various filters to sharpen or provide 
certain information that will actually modify the signal without controlling it per se. 

Finally, the third category is using the primary and secondary information to drive 
the other generators that might be present within the multimedia system. This can be 
utilized to either enhance the multimedia information or enhance the program model. An 
example of this is the use of real-time graphics frequency spectrum displays to enhance a 
music juke box type of program model. 
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As is seen in Figure 7, the primary multimedia information layer can be compressed 
to reduce the bandwidth utilizing well known algorithms. It is also seen that the signal can 
be replaced by a generator that is responsive to the primary/secondary layers signals. 
Finally, a key code could be used to cause information to be provided from a look-up table 
or the like. 

Although all of the above methods provide advantages in accordance with the 
present invention, key coding has some additional non-obvious advantages when utilized in 
the optimization system of the present invention. In the following paragraphs the use of 
various key coding systems will be described generally along with their attendant 
advantages. 

Typically, when looking at an interactive multimedia information signal there are 
several components of that information. The first component is the data or the multimedia 
information itself that is being conveyed. The second component is referred to as program 
model dynamics. That is the changes that occur in the interactive multimedia information 
due to, for example, a fade that allows for a transition from one scene in the graphics or 
video image to another. Conversely, if you want to wipe away an image there is information 
associated with the multimedia data that would call out for that transition to change 
efficiently. 

Finally, the third category of interactive multimedia information is what will be 
referred to in this specification which will allow a particular device or system to go from one 
category to another. In a typical interactive multimedia information system all this 
information is required to adequately transmit such information. 

In its simplest form, a key has an identifiable code which dictates the commands on 
the other side of the device. The clearest example of such a keying system would be the 
very simple dual tone multi-frequency (DTMF) signal. This type of signal can be used in 
the telecommunications area to provide keying for low bandwidth protocol. These keys 
would then command a code table on the side of the network to provide certain information 
about the multimedia information to be displayed without requiring actual transmission of 
the multimedia information. 

A more specific version of this type of key coding is what will be referred to in this 
specification as control information keying. What is meant by controlled information 
keying is where a key code is utilized to access particular types of commands which can 
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then be used to control other items on the other side of the network. 

Such a table would then be utilized to access a certain set of multimedia information 
in the network. A final version of key coding will be called program branching keying is 
described by each of the keys representing a certain branch identification. Thus in this type 
of key coding the key is cross referenced to a particular branch of the interacts multimedia 
program where each of the branches allows plurality of functions or commands to be 
accessed in order to replicate the program model. 

The important feature that is provided by all of these types of keying coding 
arrangements is that information already present on the network can be utilized. Therefore, 
the processing power inherent in the network or the system being accessed can be utilized 
rather than having to have to provide that processing power within the optimization system 



itself. 



It is also important to develop means to improve the transmission quality of the 
multimedia information, for example, the information may be transmitted utilizing a typical 
transmission algorithm with standard communication file data transfer protocols. The 
interactive multimedia information could also utilize specialized protocols that are 
optimized for the particular interactive multimedia information that is to be transmitted. In 
so doing the algorithm for the compression algorithm can be interactively matrixed with the 
transmission algorithm to provide the highest quality information with the maximum 
interactivity with the minimum transmission line. 

Referring now to Figure 8, what is shown is a flow chart that shows the cooperation 
of the transmission algorithm with the compression algorithm to produce a high quality 
multimedia image. The flow chart comprises providing a program model in which the 
primary and secondary layers are separated (block 402). The primary layer is compressed 
and encoded (blocks 404 and 406). 

A control element (block 410) is utilized to control a compression matrix and a 
transmission matrix. These two matrices comprise a plurality of compression algorithm and 
transmission algorithm respectively that are interactively controlled such that as the various 
algorithms are detected the quality of the multimedia information and the speed of the 
transmission are interactively determined. 

The quality of the information could be determined manually or through the use of 
some control circuitry. It should be understood that these same matrices could also be used 
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on the secondary layer. It was not shown or described for purposes of clarity and simplicity. 

Referring now to Figure 9 what is shown is a block representation of a matrix of 
compression algorithm with transmission algorithm that could be utilized in accordance with 
the present invention. The circles 502 aligned in the vertical direction are the compression 
algorithms. The rectangles 504 aligned in the horizontal direction are the transmission 
algorithms. 

For example the compression algorithms could be JPEG, a generator with MIDI, and 
a key for a weather map background. Similarly, the transmission algorithms could be 
optimized for JPEG, data compression for MIDI, or DTMF for key transmission type 
algorithms. To provide the highest quality multimedia information while at the same time 
utilizing minimum bandwidth the different algorithms can be selected in an interactive 
manner. 

Hence, a first compression algorithm could be selected along with the first 
transmission algorithm. The multimedia information is reviewed either for image or audio 
quality than a second compression algorithm is selected. The multimedia information is 
reviewed and if the quality is not acceptable then a second transmission algorithm is 
selected. The quality of the information is reviewed. This process is repeated until the 
highest or desired quality multimedia information and interactivity speed are provided. 

The multimedia information derived from the compression/transmission algorithms 
can be analog or digital in nature. However, in a digital signal there are certain other 
features that can be taken to advantage that can be utilized in accordance with the present 
invention. 

It is known that digital data information is typically sent in a file which specifies 
certain parameters of that data and the data information itself and within the data 
information itself is information which may not change for a certain set of files. In the case 
of an image file, the header information may specify the dimensions, pixel depth, and 
certain other features of the particular image. This file may take up a much as twenty 
percent of the data file. 

Conversely, in a file such as MIDI music file which comprise a plurality or a series 
of music notes, the header may include instrument information, related information and 
characteristics of that particular file. In both of the above mentioned examples, the header 
information may not change, through the use of the optimization method the amount of 
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information may be significantly reduced over time. 

Hence, in the case of the image file, the header could be sent first with no 
compression or with lossless data compression as the secondary file because it will always 
remain the same. The data file itself can then be compressed down to its smaller size. 

Another method for enhancing the psychographic parameters is to provide some 
form of error detection and adjustment. As has been mentioned before the detection and 
adjustment can be accomplished via interpolation of the error. An alternative method of 
error corrector is through an error correction/transmission algorithm. What is meant by this, 
is relating the transmission to the compression to enhance interactivity. 

In this type of system before the file is sent the base file is compressed and then 
decompressed. This decompressed file is called an expanded compressed base file. The 
expanded compressed base file is then compared to the original base file and an error file is 
then developed (the error file being the difference between the base file and the expanded 
compressed base file). The error file is compressed and sent along with the compressed 
version of the base file down the line. These files are then combined and decompressed to 
provide an enhanced image. 

Referring now to Figure 10 it is seen that a data file utilizing this technique could 
initially be separated into primary and secondary layers. The primary layer could be 
compressed using a first compression algorithm, the header could be sent first along a first 
transmission path and the compression signal could be sent along a second transmission 
path. 

Therefore, the amount of storage necessary for the file is significantly reduced 
through secondary compression techniques. This information can then be transmitted or 
stored across the network rather than having to have all the information stored within a 
2 5 particular device within the optimization system. 

It should be understood by one of ordinary skill in the art will recognize that the 
number of algorithms is not limited to the number shown in the figures. In addition it 
should be recognized that the order or the selection of the algorithms could be changed and 
that would be within the spirit and scope of the present invention. 

The present invention has been discussed in terms of compressing the primary layer 
or layer and by compressing and transmitting that primary layer in a particular way the 
interactivity of the system is enhanced. It should be understood that it may be equally 



20 



30 



PB OOCID:<WO Mie0eBA1> 



SUBSTITUTE SHEET (RULE 26) 



WO 98/16028 



24 



PCTYUS97/18267 



important to enhance secondary layers to produce the same effect. 

Therefore, it may be important to enhance the secondary layer, it may be important 
to enhance the primary layer or it may be important to enhance both. Therefore, the present 
invention through the use of compression and transmission algorithms and through the 
psychogTaphic enhancement of the program model can enhance interactivity of a multimedia 
system. 

It should also be understood that the function of the compression and transmission 
algorithms can also be done through other means; for example, a signal generator could be 
used to provide the same information. That is, a signal generator responsive to a particular 
layer or layer of information could be utilized to provide that information or some level of 
information that is representative of that layer. For example, a tone generator responsive to 
a signal from the secondary layer to provide the tone that would be representative of that 
secondary layer. 

Conversely, some type of graphics generator could be utilized to respond to that 
same type of signal to provide a certain type of graphic image in a video system. Finally, it 
should also be understood that the psychographic parameters can be adjusted by human 
operator or in the alternative can be adjusted or modified by an automatic means. 

As has been before mentioned, it also is very important in this system architecture to 
have an interactive multimedia device 1 10 which will allow for the receipt of high quality 
multimedia information from the system architecture. The IMDs 1 10 can be either located 
in the facility in the basement or are utilized with each of the television monitors within the 
hotel or hospital room to provide enhanced audio, video and graphic information within the 
closed cable system. 

Figure 1 1 is a preferred embodiment of an interactive multimedia decoder (IMD) 
1 10. The IMD 1 10 comprises several components. The cable or telephone line is coupled 
to a multimedia modem 1 102. The multimedia modem 1 102 is coupled to a multimedia 
memory 1 104 which can be an expandable dynamic random access memory (DRAM) 1 104. 
The multimedia modem chip 1 102 provides data to a multimedia decompressor device 
1 106. The multimedia memory 1 104 provides data to graphics/character generator 1 108, 
speech generator 1 1 10 and music synthesizer 1112. In addition, the output of the generators 
1 108, 1 1 10, and 1 1 12 are provided to a video control chip 1114. Video control chip 1114 
provides signals to a standard television display and receives signals from a standard 
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television source. The multimedia modem 1 102, the multimedia memory 1 104, the 
multimedia decompressor 1 106, the multimedia digital/audio control 1 108, the video control 
chip 1 1 14 and music synthesizer 1 1 12 are all ultimately controlled by an interactive control 
interface 1 1 16 which manages the operation of all of the above elements. The video control 
chip 1 1 14 is coupled to a standard telephone keypad input or for a television remote-type 
device or a special IMD remote can be utilized in a variety of ways which will be discussed 
in detail hereinafter. 

Personalized and Demographic information can be stored on the IMD 1 10, the MPS, 
or the PMS including age, sex of the user alone with technical information (IMD serial no, 
generators available). Therefore, upon connecting to the MPS 102, the IMD 1 10, or PMS 
can both forward this stored information either at the beginning of the session or anytime 
afterwards. This information can then be updated through the MPS 102 or directly at the 
IMD 1 10 through selection using the keypad or outside dialing or remote or by receiving the 
data from the MPS 102. 

Accordingly this information provides the basis for highly accurate market research 
and commercial monitoring. Through the IMDs and MPS real time information can be 
provided to the supplier of the information. This information can also be utilized to provide 
interactive advertising based on the choice of the advertiser as well as the demographics of 
the viewer. The type of information that could be useful for example would be the logging 
of each key stroke made on a remote control thereby monitoring the "browsing" or viewing 
habits of the customer in response to either interactive material supplied by the IMD or 
synchronized material from the cable head-end 122. 

In the case of room shopping, a guest can select information for presentation and 
then can choose items and then bill items to the room via the Internet or other means using 
the previously mentioned high speed access Internet system. As an alternative, the MPS 102 
can allow for the use of a credit card to forward information on to an automated order 
system or to an operator. In addition, this type of system could allow for a facsimile receipt 
to be sent back to guest via the television monitor within the room. 

Another mode of operation is the delivery of multimedia information during the 
period that the communication network is not in use. In this way large amounts of 
multimedia information can be efficiently transmitted and stored in the IMD for later review 
and enhanced interactivity. 
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The function of each of the different components in a preferred embodiment is 
described in a summary fashion below. 

Multimedia Modem 1 |0? 

A. Responsible for all communications between cable or phone line, optional serial 
port, interface to multimedia memory, multimedia decode, audio control, and processor 
control modules. 

B. Supports standards protocol for half-duplex, full duplex, and half-duplex high speed 
operation. 

C. On-chip encode/decode capability, D/A, A/D for voice, facsimile, and data 
functions. 

D. Dual tone multi-frequency (DTMF) detect and generation. 

E. Auto-detect voice/facsimile/data switch for transparent mode transition. 

F. Incorporates controller unit with binary file transfer, facsimile, data, and voice 
modes, and optional proprietary multimedia processor control optimized protocol firmware. 

G. Firmware allows IMD to use multimedia modem to perform call processing function 
including telephone call dialing and connection, unattended receipt of data and fax among 
other functions. 

H. Include ability to decode data from video cable signal including VBI encoded data 
or data encoded in the video signal itself outside the VBI. 

Multimedia Memory 1 104 

A. Nominal DRAM or VRAM for image mixing/processing, and auxiliary multimedia 
data store. 

B. Nominal ROM for resident IMD control program. 

C. Optional co-resident DRAM for multimedia data store and program/data store. 

D. Optional non-volatile storage (extendible). 

E. Memory control unit for VRAM/ROM/DRAM and non-volatile storage. 
Multimedia Decode 110ft 

A. Responsible for real-time decompression of images transferred to or stored in the 
IMD 110. 
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B. On chip inverse discrete cosine transform processor. 

C. Reverse quantizer decoder/tables. 

D. Built-in zoom, pan, chroma key, mix from compressed data incorporates interfaces 
to video data bus, multimedia memory, multimedia modem, video control, and 

5 microprocessor control sections. 



Video Control 11 H 

A. Responsible for all IMD 1 10 video mixing, enhancements, and display functions. 

B. Pixel processor for mix, zoom, pan, chroma key, transform on pixel data, transitions. 
10 C Graphics processor for figures (e.g., rectangles with color fill) generation, sprites, 

text with foreign characters, and scrolling. 

D. Digital to analog conversion, analog to NTSC, NTSC video plus stereo audio to RF. 



15 



20 



Graphics/Ctairacter. Speech Generator. Musi c Synthesizer 1 108. 1110. and 1 113 

A. Responsible for enhancing received analog/digital audio, music synthesis generation, 
and overall analog mixing and audio effects. 

B. Incorporates decoding burden. 

C Sampled instrument synthesis from compressed MIDI input. 

D. Built-in micro-controller for multi-task generation. 

E. Dual analog source mix, digital audio and synthesizer mix, analog audio control 
(volume, bass, treble, balance) for output to analog left/right audio. 



Interactive Multi-Task P rocessor 1116 

A. Responsible for multi-task execution of resident and downloaded IMD code for 

2 5 operation in conjunction or independently of the MCPS. 

B. Master/slave microcontroller architecture for multi-task control of communications, 
multimedia memory, multimedia decode, digital video control, digital audio/synthesis, and 
interface management. 

In a preferred embodiment, the IMD 1 10 will be utilized with a television monitor to 

3 0 transmit and receive multimedia information. Hence, the IMD 1 10 can be utilized in the ■ 

case of movie for access and to transmit an almost unlimited number of movies to a 
particular user. Therefore through the use of the IMDs in the system a more fully interactive 
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system is possible. In addition, through this system a variety of other serv,ces can be 
provided for the user such as advertisements, shopping, airline ticketing, entertainment and 
the like. 

Another critical feature of the IMD 1 10 is to have a remote control that will work in 
conjunction with the television or other display to provide enhanced multimedia information 
from the Internet or other on-line services. To more fully explain this feature refer now to 
Figure 12. The remote control 900 looks much like a telephone keypad. It has the numerals 
(0-9) and symbols (*-#) that are part of an ordinary telephone keypad. It includes an enter 
key 902 that is typically utilized to change information or change channels in the case of a 
television set. The control 900 would also include a volume key 904 and a channel or 
memory select key 906, a connect key 908. a telephone call key 909 and a multimedia 
toggle button 910. The telephone call key 909 is utilized to place a call to a designated 
telephone number or to a number associated with the multimedia information being viewed. 
The remote control 900 also includes a keys 91 1, 913, 915 that will control the fast forward, 
1 5 reverse, and slow motion of the display device. 

The remote control 900 could also include a credit card slot 912. This credit card 
slot 912 would be utilized by the viewer to allow for the purchase of certain items directly 
while viewing the television screen. The credit card slot 912 could also be utilized as an 
indicator that a certain room is being occupied by a particular person. This indication would 
preclude the need for a separate inputting of the relevant user information for billing 
information. The credit card information could also be accessed by a credit card slide that is 
physically connected to the television by passing the information through the remote control 
cable back channel. 

Finally, the control 900 includes special effect keys 916, for example, for allowing 
for the browsing of a multimedia directory while simultaneously displacing a picture in the 
picture of the current broadcast TV channel. The remote control 900 can operate in an 
emulated keystroke mode in which pressing one key may be utilized to emulate a 
combination of keystrokes. In addition a call button may be provided which would allow 
for sending valid numbers to another location. The remote control 900 also has the 
capability of emulating other remote controls. For example, through the MPS different 
types of signals can be mapped with the remote control. The MPS provides the translation 
of the signals of a CD/I device for example. 
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The remote control 900 could utilize a radio frequency signal or audio signal to 
interact with the receiver and/or IMD 1 10 for the control of the IMD 1 10. control the 
selection of multimedia information, and for the control of other devices. It is also known 
that a more conventional remote control could be utilized such as one that controls a VCR or 
a television and its use would be within the spirit and scope of the present invention. The 
remote control 900 also includes a positioning function. Accordingly, a motion detector or 
the like can be utilized within the remote to allow for pointing the remote at the television 
monitor to transmit certain information. 

Another feature of the above-identified system architecture is that the program 
information can be linked to the network to provide for enhanced interactivity and program 
quality. This has particular advantages when utilized with on-line services. For example, 
the program source can follow or be synchronized with the cable or broadcast feed to 
provide for enhanced distribution of program information. One specific example of this to 
take a new program, like CNN broadcasting, which consists of several short news items. 
For each news there could be stored large archives or program material related to a 
particular story. Hence, through multimedia interaction with for, example, the remote 
control 900 the stored program material can be accessed. This would allow the user to 
review the material in whatever detail was desired. 

Another example, is in an advertising feed if a particular item was advertised, there 
would be the ability to refer to more detailed information about the product via the Internet 
or other on-line services. 

Yet another example of such a system is to have one service linked to another. An 
advertisement could be linked to a means for ordering the particular product being 
advertised including the placement of a phone call by the IMDs to the desired telephone 
number. In so doing, the linked system allows for additional services to be accessed. 

The important requirements for this linked feature is that there is a knowledge of the 
contents of the system program requirements and there is a knowledge of where the user is 
in the program. For example, an IMD could be used for channel program identification in 
which the telephone call is linked to a particular channel that has been selected. Another 
3 0 example is link demographics for targeted interactive advertising. Hence, in an 

advertisement for a diaper, for example, there would be the facility to access advertisements 
for related items such as baby powder, baby oil or the like through the use of this linked 
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approach. Accordingly, this feature of the system can be utilized advantageously with the 
high speed Internet access described above to provide for enhanced interactivity. To more 
particularly describe these advantages refer now to the following examples. 

5 Reservation System 

A first example of this feature is a reservation system. Referring to Figure 13 which 
is a flow chart of such a system is selections can be reviewed via step 1302, then the 
customer can make a selection via step 1304 by reviewing the multimedia information on 
the television. If the selection is not available via step 1 306 then the user can review 
1 0 selections and make another choice. However, if the selection is available then the 

telephone system within the hotel is contacted by the MPS 102 via step 1308 so that the 
reservation can be made. Thereafter the reservation is made via step 1310. 

An example of this could be the linking of an interactive voice response system to a 
multimedia system. In a preferred embodiment, a call can be linked to a particular website 
15 in the Internet. For example, this system could be linked to a "900" number for the Wall 

Street Journal stock information. Thereafter, credit card verification can be entered by hand 
and/or by a credit card slot on the phone or the remote. More information could then be 
displayed, such as stock price graphs, on the TV synchronized with the latest news and price 
for the particular stock. Finally, system could allow for a voice annotated facsimile that 
20 could be printed at the front desk of a hotel or the like. Alternatively the call and print 

synchronization could be accomplished by using a Web telephone connection through the 
Internet. This provides a connection from a website to a telemarketing group such as AT&T 
via the PBX. 

2 5 Catalog Shopping 

Another example of the use of this system is illustrated by catalog shopping. 
Referring now to Figure 14 in such a system there is updatablc multimedia information that 
is viewed by a customer via step 1402 on the television monitor. Thereafter the customer 
can select from a number of shopping sources via step 1404. Whether the interactive 
devices are in a central location or in a each room the customer can order by the device 
interacting with a catalog order desk located in the facility which then bills the customer via 
step 1406. The billing can occur directly through the account computer of the facility i 
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the other hand can charged through a credit card transaction. 

That transaction can be completed step via the credit card slot on the remote control 
900, a credit card slot that may be located on the monitor or interactive device or teleph. 
or finally the numbers on the credit card could be entered utilizing a remote control or the 
like. The MPS 102 can then generate a mail order facsimile directly to cataloger facsimil 
telephone line via step 1408. The MPS 102 then sends the order to the source via step 1410. 
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A customer receipt can then be printed at the front desk through a special printer and 
then the goods can then be delivered via steps 1412 and 1414. The goods could be delivered 
either to the hotel facilities, to the customers home or to her place of business. Finally, there 
could be variety of methods of delivery and there use would be within the spirit and scope of 
the present invention. 

Accordingly, this system can be utilized effectively in a voice response system. 
Through the present invention a voice response can activate or operate in conjunction with a 
multimedia program to provide a fully interactive communication system. For example a 
facsimile message can be displayed on a television screen based on the voice response 
system. 

Referring now to Figure 14a what is shown is an automated call processing system 
of Figure 14. In this embodiment the system places a call to the telephone number of the 
catalog source via step 1408-1, then the MPS 102 connects to the catalog source via step 
1408-2 and send, an automated message such as "You have reached the cable network for 
ABC hotel, press 1 to confirm." After the connection is confirmed the MPS 102 it will then 
send order information to the catalog source via step 1410-1 . The source will then 
acknowledge the order via step 1410-2. The source could for example confirm credit card 
information and the like during this step. 

Video R eservation 

Another example of the utility of the present invention is its use in a video 
reservation system within a hotel system or the like as shown in Figure 15. Through this 
system even those movies being viewed can be reviewed via step 1502. The customer can 
also determine when the video will be available via step 1504. The customer can the reserve 
the movie at a later time based upon the reviewed information via steps 1 508 and 1 5 1 0. 
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A variation on this type of system is illustrated in Figure 15a which is an allocated 
movie selection system. In this system movies could be viewed within a certain margin of 
time such as within 15 minutes after the hour step 1508-1. If the customer does want to see 
the movie, step 1510-1 then the movie is selected to be seen at the allocated time, if not the 
other choices can be viewed step 1508-1. 

Ticket or Coupon Printing 

Referring now to Figure 16 in a ticket or coupon printing system there is updatable 
multimedia information that is viewed by a customer via step 1602 on the television 
monitor. Thereafter the customer can select from a number of ticketing or couponing 
sources via step 1604 including on-line services. In a preferred embodiment, the customer 
could use an appropriate website for ticketing and various other information. This system 
can also be based upon demographic data to drive the coupon or ticket choices or attributes 
presented to the customer. Whether the interactive devices are in a central location or in a 
1 5 each room the customer can order by the device interacting with an on-line service or the 

like through a high speed service center which then bills the customer via step 1606. The 
billing can occur directly through the account computer of the facility or on the other hand 
can charged through a credit card transaction. 

In an Internet example, for ticketing, that transaction can be completed step via the 
2 0 credit card slot on the remote control 900, a credit card slot that may be located on the 

monitor or interactive device or telephone or finally the numbers on the credit card could be 
entered utilizing a remote control or the like. The MPS 102 can then generate a mail order 
facsimile directly to telephone line via step 1608. The MPS 102 then sends the order to the 
source via step 1610. 

A customer receipt can then be printed at the front desk through a special printer. 
Then the tickets or coupons can then be delivered via steps 1612 and 1614. The tickets or 
coupons could be delivered either to the hotel facilities, to the customers home or to her 
place of business. Finally, there could be variety of methods of delivery and there use 
would be within the spirit and scope of the present invention. 

This system would have particular utility in conjunction with multimedia yellow 
pages. Hence, the customer can review through advertising typical vendor information as 
found in the yellow pages except now this information is reviewed from a television. 
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Selections can be made using the remote control 900 to obtain certain information and 
thereby causing several related actions to occur. By placement of the telephone call a 
vendor could issue a ticket or coupon for a product or a service. An important feature for 
the printing of documents is the need for an inventory control system in which the customer 
can gain access to information that pertains to her transactions. 

Map Printing 

Referring now to Figure 17 in a map printing system there is updatable multimedia 
information that is viewed by a customer via step 1702 on the television monitor. Thereafter 
the customer can select from a number of mapping sources via step 1 704. Whether the 
interactive devices are in a central location or in a each room the customer can order by the 
device interacting with a catalog order desk located in the facility which then bills the 
customer via step 1 706. The billing can occur directly through the account computer of the 
facility or on the other hand can charged through a credit card transaction. 

That transaction can be completed step via the credit card slot on the remote control 
900, a credit card slot that may be located on the monitor or interactive device or finally the 
numbers on the credit card could be entered utilizing a remote control or the like. The MPS 
102 can then generate a mail order facsimile directly to telephone line via step 1708. The 
MPS 102 then sends the order to the source via step 1710. 

A customer receipt can then be printed at the front desk through a special printer and 
then the maps can then be delivered via steps 1712 and 1714. The maps could be delivered 
either to the hotel facilities, to the customers home or to her place of business. Finally, there 
could be variety of methods of delivery and there use would be within the spirit and scope of 
the present invention. 

Inventory Control Sv^m 

Referring now to Figures 18a and 18b what are shown is an electronic inventory 
control system 1800 and a physical inventory control system 1800'. Referring first to Figure 
18A the electronic control system includes a personal computer 1802 with an associated 
display in this case a CRT display 1806. Also coupled to the personal computer is a keypad 
1808 and a printer 1804. The printer in turn is coupled to an output device 1810. In such a 
system the keypad 1808 can be utilized by the customer in much the same way as an 
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automatic teller machine (ATM) in which the customer has a security code through the use 
of a room key to allow the customer to order tickets or make reservations via the personal 
computer 1802. The computer is linked to the MPS 102 to allow for secure access to the 
various sources of information. The display 1806 can be utilized to interactively operate 
5 with the personal computer to cause the printing out of the appropriate transactions via the 

printer 1804. The printer 1804, typically a laser printer or specialized ticket printing 
machine prints the information and provides that printed information or ticket to a secure 
output device 1810. 

Figure 18B has similar elements to Figure 18a, however the physical system 
1 0 includes a tray for receiving the transactional information. Therefore each customer can 

have access to an individual tray of information by using their hotel key or the like. Through 
the inventory control systems shown in Figures 18a and 18b the customer has secure access 
to interactive multimedia transactions. 

In yet a final example, the system can be configured for play along games. 
1 5 Accordingly, an interactive game could be provided which would allow for an individual to 

play a game such as chess, with another guest in the hotel or against a machine as in the case 
of a video game or the games could be played with sources outside the network through the 
on-line service. 

It should be understood that the IMD 110 itself could be utilized as a call processing 
system. Finally, it should be understood that there could be multiple MPS 102 to provide for 
very large scale call processing through the MPC 109. 

Although the present invention has been described in accordance with the 
embodiments shown in the figures, one of ordinary skill in the art recognizes there could be 
variations to the embodiments and those variations would be within the spirit and scope of 
the present invention. Accordingly, many modifications may be made by one of ordinary 
skills in the art without departing from the spirit and scope of present invention, the scope of 
which is defined solely by the appended claims. 



20 



25 



0 N 0 OO CI D: <WO 8S1SQ2SA1> 



SUBSTITUTE SHEET (RULE 26) 



WO 98/16028 



35 



PCT/US97/18267 



CLAIMS 

WHAT IS CLAIMED IS: 

1 . An interactive system for a closed cable network comprising : 

means for processing multimedia information received from an on-line 

service; 

means coupled to the multimedia processing means for controlling 
transmission of the multimedia information of the on-line service to the multimedia 
processing means; and 

a plurality of multimedia devices coupled to the multimedia processing 
means to provide updatable multimedia information from the on-line service. 

2. The system of claim 1 in which the plurality of multimedia devices includes 
a CD player. 

3. The system of claim 1 in which the plurality of multimedia devices includes 
a personal computer. 

4. The system of claim 1 in which the plurality of multimedia devices includes 
a video camera. 

5. The system of claim 1 in which the plurality of multimedia devices includes 
a laser disk player. 

6. The system of claim 1 in which the plurality of multimedia devices includes 
interactive multimedia decoder (IMD). 

7. The system of claim 1 in which the plurality of multimedia devices includes 
at least one interactive multimedia device and at least one video camera to provide a point to 
point video system. 
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8. The system of claim 1 in which the plurality of multimedia devices includes 
at least one interactive multimedia device (IMD) and at least one video camera to provide a 
point to point video system. 

9. The system of claim 1 which further includes coupled to a multiplexer means 
coupled to an Interactive Multimedia Decoder (IMD), the multiplexer means for receiving 
inputs from the plurality of multimedia devices and for selecting from the plurality of 
multimedia devices to provide a multimedia output signal to the IMD. 

10. The system of claim 1 which further includes a global multimedia 
multiplexer (GMM), the GMM further including means for receiving inputs from the 
plurality of multimedia devices, and for selecting from the plurality of multimedia devices 
to provide a composite multimedia output signal to a plurality of interactive multimedia 
decoders. 

11. The system of claim 1 in which the plurality of multimedia devices includes 
at least one interactive multimedia device (IMD) and at least one video camera to provide a 
multipoint to point video system. 

12. The system of claim 1 in which the system is utilized with a voice response 

system. 

13. The system of claim 12 in which the voice response system provides a facsimile 
image on a display. 

14. The system of claim 1 in which the controlling means comprises: 
means for transmitting the multimedia information, the multimedia 

information including multiple layers, 

means for separating the multiple layers of information into primary and 
secondary layers based upon a program model, 

means for enhancing the primary layers through psychographic parameters in 
accordance with the program model, 
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means for providing the secondary layers through alternate psychographic 

parameters, and 

means for combining the enhanced primary layers and the secondary layers 
to provide multimedia information that is a perceived improvement in quality. 
5 15. The system of claim 1 in which the separating means further comprises 

means for interactively separating the layers based upon the program model into pnmary 
and secondary layers. 

16. The system of claim 1 in which the pnmary layers are high bandwidth/high 
1 0 use information and secondary layers are low bandwidth/low use information. 

17. The system of claim 1 in which the enhancing means further comprises 
means for encoding the pnmary layers in accordance with a first compression algorithm. 

15 18 * The system of claim 1 in which the enhancing means further comprises 

means for encoding the primary layers in accordance with a first transmission algorithm. 

19. The system of claim 1 in which the enhancing means further comprises 
means for encoding the secondary layers in accordance with a second transmission 
2 0 algorithm. 



20. The system of claim 1 in which the enhancing means further compnses. 
means for encoding the pnmary layers in accordance with a first 
compression algorithm; 

means for encoding the primary layers in accordance with a first 
transmission algorithm; 

means for determining the perceived quality of the multimedia information; 
if the perceived quality of the multimedia information is not acceptable; 

means for encoding the pnmary layers in accordance with another 
compression algorithm; 

means for encoding the primary layers in accordance with another 
transmission algorithm; and 
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means for repeating the encoding until the perceived quality of the 
multimedia information is acceptable. 

21. The system of claim 20 in which the providing means further comprises 
means for encoding the secondary layers in accordance with a second algorithm. 

22. The system of claim 2 1 which includes means for decoding the primary and 
secondary layers. 

23. The system of claim 1 in which the psychographic parameters include color, 
temporal, audio, spatial, and material content. 

24. The system of claim 1 in which the separating means is automatic. 

25. The system of claim 24 in which the automatic separating means is 
accomplished via separate sources for the production of the primary and secondary layers. 



is 



26. The system of claim 24 in which the automatic separating means 
accomplished via keying the primary and secondary layers to a the interactive multimedia 
2 0 information. 



27. The system of claim 24 in which the automatic separating means 
accomplished by spatially separating the primary and secondary layer. 



is 



28. The system of claim 24 in which the automatic separating means is 
accomplished by filtering the primary and secondary layers. 

29. The system of claim 1 in which the controlling means composes the steps of: 

means for separating the multimedia information into separate layers with 

each layer having a particular psychographic parameter information composition for a 
particular program model, 

means for applying a separate encoding for each of the separate layers of 
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multimedia information which maximizes the perceived quality of the multimedia 
information, 

means for transmitting the separate encoded layers along different 
transmission mediums, 

means for decoding the separate encoded layers, and 
means for recombining the separate layers of multimedia information at a 
transmission end to provide an improved quality multimedia information. 

30. The system of claim 29 in which the separating means comprises means for 
automatically separating the layers such that the psychographic parameters are interactively 
enhanced. 

31. The system of claim 30 in which the automatic layers separation compnses 
providing the layers by separated production sources. 

32. The system of claim 30 in which the automatic layers separation comprises 
keying the layers to the psychographic parameters. 

33. The system of claim 30 in which the automatic layers separation comprises 
spatially separating the layers in accordance with the psychographic parameter. 

34. The system of claim 30 in which the automatic layers separation comprises 
filtering the layers in accordance with the psychographic parameters. 

35. The system of claim 29 in which the separating means comprises 
interactively separating the layers for highest program model quality and maximum 
interactivity. 

36. The system of claim 34 in which the separating means further comprises 
means for interactively separating the layers into primary and secondary layers, the primary 
layers including the most important multimedia information to be transmitted. 
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37. The system of claim 36 in which the applying means further comprises 
means for encoding the primary layers in accordance with a first compression algorithm. 

38. The system of claim 34 in which the psychographic parameter information 
includes spatial, temporal, audio and material content perception. 

39. The system of claim 36 in which the applying means further comprises 
means for encoding the primary layers in accordance with a first transmission algorithm. 

40. The system of claim 36 in which the applying means further comprises 
means for encoding the secondary layers in accordance with a second compression 
algorithm. 

41. The system of claim 36 in which the applying means further comprises 
means for encoding the secondary layer in accordance with a second transmission algorithm. 



42. A high speed access system of at least one on-line service in a closed cable 
system comprising: 

an antenna for receiving satellite signals relating to the at least one on-line 
service; a communications controller coupled to the antenna means for converting the 
satellite signals to data signals; and 

at least one computer workstation coupled to the communications controller 
for receiving the data signals from the communications controller to provide high speed 
access to the on-line service. 

43. The high speed access system of claim 42 which includes a printer means 
coupled to the controller and the at least one workstation via a bus. 

44. The high speed access system of claim 43 in which a plurality of computer 
workstations are coupled via a bus. 
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45. The high speed access system of claim 44 m which the outbound 
transmissions will be provided over conventional telephone lines while inbound 
communications will be provided over the antenna. 

46. A system for interactively providing enhanced information related to a 
closed cable network, the system comprising: 

means for linking an on-line service to a telecommunications service; and 
means for synchronizing call and print information from the on-line service 
and telecommunications service. 

47. The system of claim 46 including means for synchronizing the call and print 
information through a web site provided on the on-line service. 

48. The system of claim 46 in which the linking can be provided through a hotel 
messaging system. 

49. The system of claim 46 which further comprises: 

means for separating the information into primary and secondary layer based 
on a program model; 

means for storing the primary information locally; and 
means for storing the secondary information remotely. 

50. The system of claim 49 in which the program model could be a specified 
modeling language such as HTML. 

51. The system of claim 49 in which the program model could be a specified 
modeling language such as VRML. 

52. The system of claim 49 which includes means for controlling information 
via a keyboard via an infrared connection. 

53. The system of claim 49 which includes means for controlling information 
via a telephone. 
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54. The system of claim 49 in which couponing or ticketing are linked via the 
Internet. 
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